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ABSTBACT 

Evaluation of effective classroon teaching has long 
plagued school supervisors and administrators. Bating is generally 
done with criteria which varies according to the educational 
objectives of the rater as well as with his subjective inpressicns of 
the staff meober being rated. Counselor Educators are faced with a 
similar problem when attempting to evaluate the practicum student*s 
performance in the counseling situation. In 1965 Flanders published 
in an O.S. Department of Health, Education and Nelfare monograph a 
system of quantifying selected verbal interaction between teacber and 
students whereby meaningful interaction between them in the classroom 
could be explored. This technique of interactional analysis lends 
itself to adaption for the evaluating the interaction of the 
counseling situation. By categorizing the possible responses in the 
counseling interview, recording them at timed intervals, and entering 
these data into a matrix, a comparison and analysis of the client and 
counselor responses are available. This paper is an explanaticc of an 
attempt to accomplish such a task. (Author) 
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tvaluation of effective classroom teaching has long plagued sciiool 
supervisors and administrators. Rating is generally done with criteria 
which varies according to the educational objectives of the raters as well 
as with their subjective impressions of the teacher being rated. The reli- 
ability as well as the validity of such ratings is questionable. 

Counselor educators are faced with a s-^ivnlar dilemma when attempt- 
ing to evaluate the precticum student's performance in the counseling situa- 
tion. By its very nature the practicum experience should be self-analytical 
and self-evaluative (Shertzer and Stone, 1966). Yet in rating counseling 
effectiveness as in rating teaching effectiveness, the very nature of the 
collected data is subjective and dependent upor the particular orientation 
of the supervisor doing the rating. 

Soar (1964) contends that a more promising approach to evaluating 
effective teaching can be made th>^ough identifying and measuring dimensions 
within the classroom that facilitate student learning and change. Teacher- 
pupil communication is such a dimension. Understanding the responses of 
the client is also a dimension of communication. The problems involved in 
':he communication process with the client are dominant problems in the 
counseling experience (Parker and Meek, 1967). Patterson (1968) notes that 
many students in current practicum procedures fall far short of offering a 
facilitative relationship of ur.Jerstandi ng, empathy, warmth, genuineness. 

Flanders (1965) has developed a system of quantifying selected verbal 
interaction between teacher and students whereby the meaningful interaction 
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between them in the clci>srooin can be .\\^>loroc]. The usc^ i Intorji:tionaI 
Analysis by Flanders and Amidon (19611) has shown a positive corr-olation 
with pupil independence. If pupil acfiioveinent , attitude, ai;d i ndopeiulence 
is related to teacher et i ^cti veness t^s stated, then tno Interactional 
Analysis system has been shown to be a reliable means of evaluating thi^; 
effectiveness. As such, it should thtwi lend itself to adaption for evalu- 
ating the effectiveness of the practicuni student in the counseling situation. 

A review of the steps involved in tlie Interactional Analysis process 
of Flanders is in order. Classroom verbal behavior is classified into ten 
categories all mutually exclusive, yet totally inclusive of all the verbal 
interaction occurring in the classroom. Using these categories a trained 
observer records every three seconds the category number of the verbal 
interaction he observes. In this manner the sequence of verbal behavior is 
captured and the type of verbal behavior that causes the following response 
to be elicited is indicated. In recording such a column of representative 
numbers of verbal behavior, the kind of response as to whether it is teacher 
or student dominant is also evident. These numbers can then be coupled into 
sequential pairs with the first number of each pair being the last number of 
the preceding pair. The pairs are then tabulated into a ten-by-ten matrix 
permitting the identification of categories of verbal interaction as observed 
for that period of time. Several aspects of interaction can be clearly seen 
in the matrix. The percentage and the kinds or categories of teacher and 
student talk can quickly be reckoned when columnar totals of category incidences 
are computed. Cross comparisons between categories of verbalization as to 
v;hether teacher talk "^s directly or indirectly influencing student talk can be 
made. All in all, the Interactional Analysis system can be a very personal 
evaluative technique for the teacher as well as being statistically verifiable 
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by research procedures. 

In adapting the Interactional Analysis techni.jut? to the counseling 
interview, attention should first be di riveted toward doveloping categories 
of responses that luay occur in an inti^rview. This would imply a survey of 
verbal techniques used to develop the counseling relationship to whicli 
specific terms can be assigned. Shertzer and Stone (1968) quote categori::ed 
verbal techniqies described by Bucheimer and Balogh that can elicit Reeling, 
facilitate self-understanding, self-action as being; restatement, reflection, 
summarization, analysis, interpretation, direct question, reassurance, assurance, 
information giving, encouragement, specific suggestion, urging, cajoling, 
silence. Miller (1962) has categorized verbal leads in the counseling inter- 
view into thirty separate types, ranging from acceptance to threat and urging. 
Colby, as quoted by Bordin (1968), lists three types of interpretation of 
counselor responses as comparisons, clarifications, and wish-defense. Counselor 
attitudes are categorized by Porter (1950) as being evaluative, interpretative, 
supportive, probing, or understanding. Rogers (1951) cites Blocksma's use of 
Porter and Axline's test showing counseling responses classified by response 
techniques as moralizing, diagnosis, inu>^rpretation, support, reflection. 

If the counselor response types along with other analogous terms as 
listed above were placed into a series of classifications inclusive of possible 
interview responses yet exclusive by category, they might be arranged as follows: 

1. Understanding, Auc^oting 

2. Reflecting, Restating, Clarifying 

3. Interpreting, Summarizing 



4. Ansvyerinrj, Explaining, Sup|)Ortinfj, 
Rfjassuri ng. Informing 
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5. P)'obiiui, flues ti on i no , Search i no, 
Investing ti ng 

6. PreJicing, Awvising, Directing, 
Jud'iinQ, Voral iziro 

y. Inawareness, Non-understandin^l, Squelch, 
InnocuoLis Statt?;iient , Irrelevant Response 

Two additional categories represonti ncj whether thr clienL's res^^ nso 
is v'ontro llovi bv the counselor or is frooly initiated, :-]us a cateqorv )\^nro- 
soi:lin9 silence ;;oiila complete a ten-category structu>^G that can w aiapt^vi 
to the Interactional Atialysis technique. 

A look at the categories described above indicates that those re- 
sponses listed in the first three classifications are more or less indirect 
in nature while those responses in categories four, five, and six vvould seem 
to involve the counselor on the direct level. A further exploration of the 
categories indicates that the counselor would tend to be subjective for the 
first three and tend to be more objective in four, five and six. Category 
seven indicates the counselor is ' out-of-touch* with client. The possibility 
of comparing the type of counselor response that elicits either type of client 
response is evident in addition to determining the frequencies of each cate- 
gory. There would be no value assigned to the numbers representing the 
different categories. They serve to identify the category for purposes of 
recording. 
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Fig. 1 



CATEGORIZING COUNSELING INTERVIEW RESPONSES 

Directions ; While you view the client and counselor responses of the 
counseling interview, record in column/s the number from the 
categories on the right side of the page that best represents 
your feelings as to the type of response being made. Begin your 
column with category 10 and end with category 10. 
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Understanding, Accepting 

Reflecting, Restating, 
Clarifying 

Interpreting, Summarizing 



Answering , Expla ining , 
Supporting , Reassuring , 
Informing 

Probing , Ques tioning , 
Searching, Investigating 

Predicting , Advising , 
Directing , Judging , 
Moralizing 



Unawareness , Non-under- 
standing, Squelch, 
Innocuous Statement, 
Irrelevant Response 



8. Client Answers 



9. Client Initiates 



10. Silence 



WKU/697071-dwm 
Counselor Ed, (exp/fev.) 



Fig. 2 

INTERACTIONAL MATRIX, 



ex. 

O 

a; 



Directions ; Record interview responses below by couplets (pairs)* 
Arrange the recorded responses frcm Fig. 1 in couplets by ccffnbining 
each number with its succeeding number. The second number of each 
couplet will hecomo tiic fL^st number in the next couplet. The couplet 
is recorded in the appropriate grid by a checkmark representing the 
intersecting of the first and the last number of the couplc-t. 

( Second Number of t he Coup let ) 
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field trials wero dos ignod and .onducte'^l to tosL tho usability and 
tho reliability jf this pronosod adaptation or riandors' Interactional 
Analysis techniaue to t'le '^-^unsel i no intorview. 

Selected audio taoe se^'i^ents wora presented to two different Counsel inc 
Theory classes at Western Kentucky University in Sin^fui ]969 and in SiM'inn l^^/\^ 
These classes were coi:^L^rised of graduate students in Counselor tducatiot^ 
grams leading tc a Master of Arts degree. 

A short training ;>eriod was conducted in each class whe^^ein students 
v/ere trained in the use of the instrument. (See Fig. 1 and Fig. 2). Practice 
tape segments were played and stoi'jped every five seconds at wliich interval 
the student would enumerate the category of response that best represented 
tli.^ soeech content of tne interview at that given instant. Discussion of 
each response category was permitted until there was general agreement among 
the students as to definition. Examples were presented orally by the experi- 
.Tienter and were also identified on the practicum tapes. The actual data 
collection was then begun. 

Test audio tapes were presented to each class; stopped at five-second 
intervals in order that categories of speech could be recorded in a time space 
of two seconds; and were continued for a total lapsed time of seven minutes. 
Seven minutes were arbitrarily adopted in order to have a representative re- 
cording of five actual minutes of counseling interview conversation. This 
raw data was then placed in the matrix (Fig. 2) and totaled by categories. 

The usability of this device v/as evident in the short training time 
necessary for it to be used (15-20 minutes); the ease vnth which the theme 
and procedures were grasped by the students collecting the data; the absence 
of extended questioning, consternation, or reticence upon the parts of the 
students performing the data collection function. The fact that tliis orocedure 



could be initicUed at anv (oint in the counsoli'u] int^^rview t'urthors its 
usabi 1 i ty . 

\n itistrunont \s reliabl^^ Co tho ostt^nt that ros:ionses romain 
nearly tlie saw repoatect use. There aro three distinct ocssiMliLies 
of establ ishinc) instruir.ent reliabilit>: test-retest with the san^^ ter:;, 
use of second eouivalent form, or th division of the instrument into ivv^o 
or more ee.uivalent fractions ofttimes refe-red to as "split-halves" nu>thod. 
The results in each of these possibilities are then compared statistically 
to establish instrument reliability. 

In this study of interaction in the counseling interview the use of 
audio tdoes for data collection purposes involved problems of establishing 
five-second intervals for recording speech categories. This could not be 
accomplished during the actual recording session without sophisticated 
electronic equipment for silently imprinting metronomic signals. Consequently, 
the "split-halves" approach to reliability testing lent itself to this study. 

The data from the Spring 1969 group were randomly divided into two 
equal parts as were the data of the Spring 1970 group. This permitted com- 
parison within each group by the "split halves" method for reliability pur- 
poses. The total responses for each category of each "split-halves" group 
were then converted into a Mean for that category and these Means were con- 
verted into percentages. (See Tables 1 and 2). This permitted the use of 
Scott's coefficient of reliability as presented by Flanders in his original 
work in the areas of interactional analysis. 

The Scott coefficient is calculated using the following formula: 



TABLt .? 

RFSPON<f prR(:E;Nr'\c[; mf ans fw caticorifs 

FOR SI'RlNr.-1970 SAMPLF 

Split-Halves Split -Mai vos DifferLMici' 
Group A Group B (A - R) 



2.8 2.4 0.4 

1.9 0.9 1.0 

2.5 2.7 0.2 
6.0 6.0 0.0 
3.3 2.9 0.4 

1.6 1.5 0.1 
0.4 0.0 0.4 
6.6 6.3 0.3 

67.1 68.2 1.1 

7.9 9.2 1.3 



5.2 



! r - p - p 

0 e 

Too '- P" 
e 



'/T = (100 - 5.2) - 47.5475 
100 - 47-5475' 



- 0.9008 
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TABir 2 

RFSPON<! PFRCFNT^CL Mf^NS RY CATIGORIFS 

FOR SPRING- 1970 SAMPLF 

Split-Halves Spl it-tldl ves Pifforencc Ave. (A+lO 

C^tegofv Group A Group P (A - R) Squ.i rod 

1 2.8 2.4 0.4 0.0676 

2 1.9 0.9 1.0 0.0196 

3 2.5 2.7 0.2 0.0676 

4 6.0 6.0 0.0 0.3600 

5 3.3 2.9 0.-1 0.0961 

6 1.6 1.5 0.1 0.0240 

7 0 4 0.0 0.4 0.0004 

8 6.6 6.3 0.3 0.4060 

9 67.1 68.2 1.1 45.7652 
10 7.9 9.2 1.3 0.7310 



5.2 47.5475 



I r - p - p 
0 e 

ID'O - P'" 
c 



'7? -- (_100 - - 4X.547b 

"W -"47-5475" 



^lY - 0.9008 
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where Pq is the difference between perfect agreement (lOO'i) and th;-* suinmod 
differences of oercentanes of disagreement in all categories, and P., is the 
square of the averages of the agreement by both groups in each category. 
The Scott coefficient then is the ratio of the amount of true agreement to 
the difference of chance agreement from a ratio of one or perfect agreement. 
This is similar to chi-square but differs in that it takes into consideration 
the interaction or sequence of category ratings. The reader is referred to 
the referenced Flanders' monograph for a more detailed explanation of this 
coefficient. 

The following reliability coefficients between "split-halves" of 
the Spring 1969 group and for the Spring 1970 group were established: 
Spring - 1969 = 0,91 

Spring - 1970 = 0,90 

These coefficients are in close agreement and being at the 0,9 levels 
would indicate a reasonably high level of reliability for the instrument. 
Flanders 1n establishing his interactional analysis categories of verbal 
behaviors of teachers reported reliability coefficients as low as 0.88, The 
data presented here would support the contention that verbal behavior in the 
counseling interview can be reliably c legoriezed with this technique. 

In summary, Flanders' technique for interactional analysis permits 
the study of verbal responses in a communication interchange. As such it 
readily lends itself to tie study of responses in the counseling interview. 
Types of responses can be categorized for the counselor and for the client 
which will permit the comparison of counselor response eliciting kind of 
client response. Percentages of total responses in each category can be 
compared to the overall number of responses recorded to indicate amount of 
interview ' versation being limited to each category, 
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rhe complete ten categories would appear as: 

1. Understandino, Acceptinq 

2. Reflecting, Rostating, Clarifying 

3. Internreting, Siininarizing 

4. Answering, Explaining, Supporting, Reassuring, Informing 

5. Probing, Ouestioning, Searching, Investigating 

6. Predicing, Advising, Directing, Judging, Moralizing 

7. Unawareness, Non-understanding, Squelch, Innocuous 
Statement, Irrelevant Response 

8. CI ient Answers 

9. Client Initiates 
10. Silence 

Further it may be assumed that the matrices used to record these categories 
of verbal interview behaviors can be utilized through comparative studies 
in establishing counselor effecti veness--a decided need for counselor training 
institutions. 

There has been little research into the supervision of the counseling 
practicum (Casn and Munger, 1966). As the practicum experience is increasingly 
becoming the major vehicle for counselor training (Shertzer and Stone, 1966) 
there is need fo. study in this important area of counselor education. An 
adaptation of the Interactional Analysis technique would provide a method by 
which verifiable research can be accomplished in this area. 
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